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Abstract 

The LULU operators, well known in the nonlinear multiresolution analy- 
sis of sequences, are extended to functions defined on a continuous domain, 
namely, a real interval. We show that the extended operators replicate the 
essential properties of their discrete counterparts. More precisely, they form 
a fully ordered semi-group of four elements, preserve the local trend and the 
total variation. 

1 Introduction 

The well known (linear-) Functional Analysis fits in appropriately in the theory 
of linear smoothers. Typically a smoother is designed to pass sequences that are 
samplings of functions with low frequencies with minimal distortion (error), but 
to map high frequencies near to the zero sequence. The least squares norm is ap- 
propriate, for various other reasons, but also that such smoothers then map a ele- 
ment Xi onto weighted averages of sequence elements in a "window" around 



{xj_„, . . . ,Xi, . . . , The linearity also ensures that sequences of elements that 

are generated identically, independently distributed from a very general symmetri- 
cal distribution e, are rapidly mapped near zero due to the Central Limit Theorem. 
When we want to smooth a sequence, we can choose to construct a convenient 
smoother that is a "bandpass" filter, and practically remove high frequencies. The 
design of such filters is done in a well established theory of Digital Filters. The book 
by Hamming [I] is well known and instructive. The essential background theory is 
Fourier Analysis. This works well because the basic trigonometric functions sin and 
cos are eigensequences of linear operators, and the "transfer function" approximates 
with eigenvalues near one in the frequencies that are to pass, and eigenvalues near 
where the frequencies are to be reduced to near zero. 

Low pass filters should therefore marginally distort sequences that are samplings 
of functions that have Fourier expansions that converge fast. This is well known to 
be related to continuity of lower derivatives. Discontinuities in low order derivatives 
result in slowly converging Fourier expansions and the digital filters will remove the 
high frequencies, distorting significantly the sequence of samplings. A typical bad 
case is isolated impulsive noise added spuriously. This necessitates the presmoothing 
by nonlinear Smoothers, of which the median smoothers, popularised by Tukey, are 
well known. Since eigensequence analysis is not natural, nor easily justifiable, for 
nonlinear operators the lack of a theory for analysis and design was considered to 
be difficult, if not impossible [9]. Design was generally essentially considered to be 
an art. 

Over the last twenty years a theory for Nonlinear (general) Smoothers, that is 
based on order structure and min/max operations, has been developed and demon- 
strated to be very consistent and useful, even able to explain most of the "good" 
behaviour of the (related) median smoothers, as well as their "enigmatic" behaviour. 
A monogram presenting the so-called LULU-theoij and its motivation and devel- 
opment appeared in 2005 [5]. The theory is based on compositions of two types of 
smoothers L„ and f/„. They are Morphological Filters with special properties. 

One of the powerful ideas resulting from this theory, was the development of 
Nonlinear Multiresolution Analysis. This was done using the heuristic ideas from 
Fourier Analysis and Wavelet Analysis. It resulted eventually in Discrete Pulse 
Transforms [2]. These transforms may turn out to be as useful for vision as the 
Fourier Transforms are for hearing p]. 

When applications of Wavelet Transforms (and Fourier Transforms) are under 
discussion it is natural for understanding to consider samplings of "band limited" 
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functions as ideal candidates for such decompositions, both for theoretical derivation 
and practical applications. For Nonlinear Decomposition there has been a lack of 
such a relation between the theory of real functions and the theory of the sequences 
that are samplings of these functions. Generalising L{7L[/-operators and the as- 
sociated theory and concepts to functions is the first appropriate attempt towards 
establishing such a link. 

Central in the LULU-theoTj for sequences are the class of locally monotone 
sequences A^„ defined as the sets of all sequences x that have {xj, Xj+i, . . . , 
monotone for each index i. We need to establish natural links between these classes 
and classes of real functions of which the sequences can be considered as samplings. 
Also natural to LULU-theoij is the Total Variation as norm [5]. There is a clue to 
establishing links with standard Real Analysis, as is typically presented by Royden 
in the first few chapters of his book [7]. Total Variation of functions and local 
monotonicity are linked to the derivative in this theory. We seek to extend and 
solidify these links with established Real Analysis of functions. To do this we, look 
at the basic ideas of the LU LU -theory for sequences [5j . We start directly with the 
definitions of the "atoms" involved. 

Given a bi-infinite sequence ^ = (^i)igz and n E N the operators L„ and Un are 
defined as follows 

{LnOi = max{min{^i_„, ^j}, min{^i, ^i+„}}, i G N 
(UnOi = min{max{^i_„, ^j}, max{^i, ^i+„}}, i E N 

In analogy with the above discrete LULU operators, for a given <5 > the basic 
smoothers Ls and Us in the LULU theory are defined for functions on Q through 
the concepts of the so called lower and upper (5-envelopes of these functions. These 
definitions are given in Section 2, where it is also shown that the operators Ls 
and Us preserve essential properties of their discrete counterparts. In particular, 
the operators Ls and Us generate through composition a fully ordered four element 
semi-group, also called a strong LULU structure, as opposed to the general weak 
L[/L[/-structure of recursions and dilations, with a 6 element semi-group that is 
only partially ordered. In particular, the crucial inequality L„?7„ > UnLn holds in 
a strong structure. This issue is dealt with in Section 3. In Sections 4 and 5 we 
discuss the preservation of the trend and the total variation respectively. 
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2 The basic smoothers and 



Let Aip) denote the set of all bounded real functions defined on a real interval 
n C M. Let Bs[x) denote the closed 5-neighborhood of x in VL, that is, Bi{x) = 
{y E fl : \x — y\ < 6}. The pair of mappings /, 5" : A{Q) — A{Q) defined by 

= snpmi{f{y):yeBs{x)}, xen, (1) 

<5>0 

S{f){x) = misnp{f{y):yeBs{x)},xen, (2) 

are called lower Baire, and upper Baire operators, respectively, [H]. We consider on 
A{Q) the point-wise defined partial order, that is, for any f,gE A{Q) 

f<9^f{x)<9{x), xen. (3) 

Then the lower and upper Baire operators can be defined in the following equivalent 
way. For every / G A{Q) the function /(/) is the maximal lower semi-continuous 
function which is not greater than /. Hence, it is also called lower semi-continuous 
envelope. In a similar way, <5'(/) is the smallest upper semi-continuous function 
which is not less than / and is called the upper semi-continuous envelope of /. In 
analogy with /(/) and S{f) we call the functions 

Is{f)ix) = mi{f{y):yeBs{x)},xen, (4) 
Ss{f)ix) = snp{fiy):yeBsix)}, xen, (5) 

a lower 5-envelope of / and an upper 5-envelope of /, respectively. 
It is easy to see from (jl]) and ([5]) that for every 61,62 > 

Furthermore, the operators Is and Ss, 5 > 0, as well as / and 5" are all monotone 
increasing with respect to the order ([3]), that is, for every f,g E A{fl) 

f<9^ hU) < hig), Ssif) < Ssig), I{f) < I{g), S{f) < S{g). (7) 

The following operators can be considered as continuous analogues of the discrete 
LU LU operators given in the Introduction: 

Ls = Ss o Is , Us = Is o Ss . (8) 

2 2 2 2 
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We will show that these operators have similar properties to their discrete counter- 
parts. Let us note that they inherit the monotonicity with respect to the functional 
argument from the operators U and S5, see ([7]), that is, for f,gE AiVt) 

f<g^ UU) < Lsig), UsU) < Us{g). (9) 

Theorem 1 For every fEA{VL) and 6>Q we have Ls{f) < f, Us{f) > f. 

Proof. Let / G A{Q), 6 > 0. It follows from the definition of Ig that for any x G 
we have h{f){y) < f{x), y G B^{x). Therefore 

Ls{f)ix) = = sup{/|(/)(2/) : y G < /(x), xeQ. 

The second inequality in the theorem is proved in a similar way. ■ 

Theorem 2 The operator Ls is monotone decreasing on S while the operator Us 
is monotone increasing on 6, that is, for any f G A{Q) and < 6i < 62 we have 

LsAf)>UAf),UsAf)<U8Af)- 

Proof. Let 82 > 5i > Using the properties (jSD the operator L^^ can be represented 
in the form 

= Ss2_ O = Ssj^ O S s2~Si O J g^-^i O I Sj^ = S Sj^ O L^j-^j ° Isj^. 

2222 222 2 

It follows from Theorem [T] that for every / G A{Q) we have -^^52-<5i(-^£i (/)) ^ -^£1 (/)• 

2 2 

Hence using the monotonicity of the operator Ss given in ([71) we obtain 

Ls,if) = < = LsM), f e Ain). 

2 2 2 2 

The inequality Us^{.f) > Us^if) is proved in a similar way. ■ 

The next lemma is useful in dealing with compositions of Is and Ss- 

Lemma 3 We have Is o Ss o Ig = Ig, Ss o Ig o Sg = Ss- 

Proof. Using the monotonicity of Ig, see ([7]), and Theorem [1] for / G A{fl) we have 
{IgoSgoIg)(^f) = Ig[L2s{f)) < hU)- On the other hand, applying Theorem[T]to U2g 
we obtain [Ig o Sg o Ig){f) = U2g{IgU)) > W)- Therefore (Ig o Sg o Ig){f) = Is{f), 
f G A{Q)- The second equality is proved similarly. ■ 
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Theorem 4 For every 61,62 > we have L^^ o L^^ = Lmax{<5i,<52} '^^'^ o = 

UmsLx{5i,52} • 

Proof. We will only prove the first equality since the proof of the second one is 
done in a similar manner. Let first ^2 > <5i > 0. Using property ([6]) and Lemma [3] 
we obtain 

Ls-^ O = {Sh O Isj^) O {Ss2 O Jij ) = (Ssj^ O Isj^ O Ssj^) O {S s2~6-^ O Jij ) 

22 22 222 22 

= Ssi O S S2-S1 O Is2 = S S2 O Is2 = Ls2- 
2 2 2 2 2 

If (5i > (^2 > in a similar way we have 

Ls^ o Ls2 = {Ss^ iSs2 0IS2) = {Ssi ° ^1-62) ° (-^52 ° Ss2 o J^J 

The proof in the case when 62 = 61 > follows from either of the above identities 
where Ss2-5i or Isi-52 respectively are replaced by the identity operator. ■ 

Important properties of smoothing operators are their idempotence and co- 
idempotence. Hence the significance of the next theorem. 

Theorem 5 The operators Ls and Us are both idempotent and co-idempotent, that 
is, Lso Ls = Ls, UsoUs = Us, {id — Ls) o (id — Ls) = id — Ls, {id — Us) o {id — Us) = 
id — Us, where id denotes the identity operator. 

Proof. The idempotence of Ls and Us follows directly from Theorem |H The co- 
idempotence of the operator Ls is equivalent to Ls o {id — Ls) = 0. Using the 
first inequality in Theorem [1] one can easily obtain Ls o {id — Ls) > 0. Hence, 
for the co-idempotence of Ls it remains to show that Ls o {id — Ls) < 0. Assume 
the opposite. Namely, there exists a function / G A{Q) and x ^ Q such that 
{Ls o {id - Ls)){f){x) > 0. Let e > be such that {Ls o {id - Ls)){f){x) > e > 0. 
Using the definition of Ls the above inequality implies that there exists y G B§_{x) 
such that for every z G Bs{y) we have {id — Ls){f){z) > e, or equivalently 

f{z)>Ls{f){z)+e, zeB,_{y). (10) 

For every z G Bs_{y) we also have Ls{f){z) > h{f){y) = inf{/(t) : t G Bs{y)}. 
Hence there exists t G Bs{y) such that f{t) < Is{f){y)+e < Ls{f){z)+e, z G Bs{y). 
Taking 2; = t in the above inequality we obtain f{t) < Ls{f){t)+e, which contradicts 
(ITUl) . The co-idempotence of Us is proved in a similar way. ■ 
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Example 6 The figures below illustrate graphically the smoothing effect of the op- 
erators Ls, Us and their compositions. The graph of function f is given by dotted 
lines. 




The functions Ls{f) and Us{f) 




The functions {Ls o Us){f) and {Us o Ls){f) 



The operator Ls smoothes the function / from above by removing picks while 
the operator Us smoothes the function / from below by removing pits. Note that 
Ls o Us and Us o Ls resolve ambiguities in a different way; Ls o Us treats oscillations of 

length less then S as picks and removes them while Us o Ls considers such oscillations 
as pits which are accordingly removed. The inequality {Us o Ls){f ) < {Ls o Us){f) 
which is observed here will be proved in the next section for any / G .4(^2). 



3 The LULU semi-group 

In this section we consider the set of the operators Ls and Us and their compositions. 
For operators on A{Q) we consider the point-wise defined partial order. Namely, for 
operators P, Q on A{0.) we have 

P<Q ^ P{f)<Q{f), feA{n). 
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Then the inequahties in Theorem [T] can be represented in the form 

Ls<id< Us, (11) 
where id denotes the identity operator on A{Q). 

Theorem 7 For any 6 > we have Us o Ls < Ls o Us- 

Proof. Let / G A{n) and let x G fi. Denote p = {LsoUs){f){x) = Ss{Is{Ss{f))){x). 
Let e be an arbitrary positive. For every y G Bs^ (x) we have 

Is{Siifmy)<p<p + e. (12) 

Case 1. There exists z G B§_{x) such that S§_{f){z) < p+e. Then f{t) < p+e for t G 
Bs{z), which imphes that Is{f){t) < p + e for t E Bs{z). Hence Ss{Is{f)){z) < 
p+e. Then {UsoLs){f){t) = Is{Ss{h{f))){t) < p+e kite Bs{z). Since x G Bs{z), 
see the case assumption, from the above inequahty we have {Us o Ls){f){x) < p + e. 
Case 2. For every z G Bs^x) we have S5{f){z) > p + e. Denote 

D = |z G 1] : Ss^{f){z) <p + eY 

We will show that for every z G Bs{x) we have 

Bs{z) nD^% (13) 

Due to the inequality ( fT2il we have that ( |T3l) holds for every z G Bs{x). Let z G 

i?5(a;) and let 2 > x + |. This implies that x + | G ^2. Using the inequality f|T2l) for 
?/ = X + I as well as the case assumption we obtain that the set (x + |, x + fl D 
is not empty. Then ^^(z) n D D (x + |, x + y] fl D 7^ 0. For 2; < x - f condition 
(fT3!) is proved in a similar way. Hence (fT3|) holds for all 2; G ^^(x). Let z G Bs{x) 
and f G -85(2/) H D. Since v E D v/e have /(t) < p + e, for t G -Bi(f). Using 
that Bs{z) n Bs_{y) 7^ we obtain that h{f){z) < p + e, z E Bs{x). Therefore 
55(/|(/))(x) <p + £. Then 

iUsoLs)if)ix) = IiiSsiIsifmx) < Ssilsif))ix)<p + e. 

Combining the results of Case 1 and Case 2 we have (^7^ o Ls){f){x) < p + e. Since 
e is arbitrary this implies that {Us o Ls){f){x) < p = {Ls o Us){f){x). m 
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Theorem 8 For a given 5 > the operators L^oUs and UsoLs are both idempotent. 
The proof is an immediate apphcation of Lemma [3l 

Theorem 9 We have Us o Ls o Us = Ls o Us, Ls o Us o Ls = Us o Ls, 5 > 0. 

Proof. Using the inequahties ffTTj) and the monotonicity of the operators Ls, Us, 
see Qj, we obtain Us o Ls o Us > id o Ls o Us = Lso Us. For the proof of the inverse 
inequality we use Theorem [7] and the idempotence of Us as follows: 

Us o Lso Us = {Us o Ls) o Us < {Ls o Us) oUs = Lso {Us o Us) = LsoUs 

Therefore Us o Ls o Us = Ls o Us- The second equality is proved in a similar way. ■ 

It follows from Theorems [8] and [9] that for a fixed 6 > every composition involv- 
ing finite number of the operators Ls and Us is an element of the set {Ls,Us,Us o 
Ls, Ls o Us}- Hence the operators Ls and Us form a semi-group with a composition 
table as follows: 





Ls 


Us 


Us o Ls 


Ls o Us 


Ls 


Ls 


Ls o Us 


Us o Ls 


Ls o Us 


Us 


Us o Ls 


Us 


Us o Ls 


Ls o Us 


Us o Ls 


Us o Ls 


Ls o Us 


Us o Ls 


Ls o Us 


Ls o Us 


Us o Ls 


Ls o Us 


Us o Ls 


Ls o Us 



Furthermore, an easy application of Theorem [7] shows that this semi-group is com- 
pletely ordered. Namely, we have Ls < Us o Ls < Ls o Us < Us- 

The smoothing of functions in A{Q) by the compositions Ls o Us and Us o Ls can 
be described through the concept of local 5-monotonicity. 

Definition 10 Let 5 > 0. A function f G A{fl) is called locally 5-monotone if 

f is monotone (increasing or decreasing) on any interval [x,y] of length not 

exceeding 5. 

Theorem 11 For any given 5 > and f G A{VL) the functions {Ls o Us){f) and 
{Us o Ls){f) are both locally 5-monotone. 

The proof uses to following technical lemma. 
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Lemma 12 Let 6 > and g G A{Q). If there exists functions (f),ip & A{Q) such 
that 

9 = (14) 
g = (15) 

then g is locally 6-monotone. 

Proof. Assume the opposite. More precisely, we assume that there exists an interval 
[a, 6] C f2, 6 — a < 5, such that g is not monotone on [a, b]. This means that there 
exists a triple {x, z,y} <Z [a,b], x < z < y, such that either 

g{z) <mm{g{x),g{y)} or g{z) > max{g{x), g{y)}. (16) 

Using the representation (fT4|) and the inclusion B^{z) C B^{x) U Bs^{y) we obtain 

g{z) = sup{0(t) : t G 5|(z)} < snp{(p{t) : t G S|(x) U B^{y)} 

= max{sup{0(t) : t G Bs{x)},sup{(j){t) : t G -61(2;)}} 

= max{g{x),g{y)}. 

Similarly, from (ITS!) it follows that (7(2;) > mm{g{x), g{y)}. Thus we have 

min{5((x),5((2/)} < g{z) < meix{g{x), g{y)}. (17) 

The contradiction between (ITBl) and (IT7I) completes the proof. ■ 

Proof of Theorem [IH Let 5 > and / G A{n). Denote g = {Ls o Us){f). 
From the definition of the operators Ls, Us, see (|8]), and Theorem [9] we obtain the 
following representations of g: 

9 = /|(5|(^5(/))) 

g = iUsoLsoUs)if) = Si{Ii{Ls{Us{fm 
Then the local (5-monotonicity of g follows from Lemma fT2l 

4 Trend preservation 

Definition 13 An operator A is called local trend preserving if for every f G 
A{Q) and interval [xi,X2] C Q the function A{f) is monotone increasing on [xi,X2] 
whenever f is monotone increasing on [xi,X2] and A{f) is monotone decreasing on 
[xi,X2] whenever f is monotone decreasing on [xi,X2]- 
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Definition 14 An operator A is called fully trend preserving if A and id — A 

are both local trend preserving. 

If A is local trend preserving operator then the local trend preserving property of 
id — A can be equivalently formulated as: if / is monotone (increasing or decreasing) 
on an interval [xi , X2] C then 

|A(/)(xi) - A{f){x2)\ < |/(xi) - f{x2)\. (18) 



Remark 15 Definition [73 and Definition I4 generalize the concepts of neighbor 
trend preserving and fully trend preserving for operators on sequences. In the con- 
text of sequences the property [T^) is called difference reducing, 



Theorem 16 If the operators A and B are fully (local) trend preserving then so is 
their composition Ao B. 



The proof is similar to the proof of the respective statement for sequences, see O 
Theorem 6.10] and will be omitted. 

We will prove that the operators L5, Us and their compositions, similar to their 
discrete counterparts, are all fully trend preserving. To this end, the following 
technical lemma is useful. 



Lemma 17 Let function f G A{VL) he given and let 6 > be arbitrary. 

a) If f is monotone increasing on the interval [xi, X2] C Q then the function Isif) 
is monotone increasing on [xi — 6,X2—S]r\Q and Ss{f) is monotone increasing 
on [xi + 6, X2 + S] n Q. 

b) If f is monotone decreasing on the interval [xi,X2] C Q then the function Isif) 
is monotone decreasing on [xi+6,X2 + 6]r\Q and Ss{f) is monotone increasing 
on [xi — 6,X2 ~ S]n Q. 



Proof. We will prove only a) since b) is proved in a similar way. Let 2/1,2/2 ^ 
[xi — 6,X2 — S]nQ and yi < y2. We have 

Is{f){yi) = inf{f{x) :xe[yi-S,y, + S]n Q} (19) 
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Since / is increasing on [xi, X2] and [yi + 5, 1/2 + S] C [xi, X2] we have f{yi + S) < f{x) 
for X G [yi + 6,1/2 + S] n Q. Therefore enlarging the interval [yi — 6,yi + S] to the 
interval [yi — 6,y2 + S] = [yi — 6,yi + 6] U [yi + S,y2 + S] is not going to change the 
value of the infimum in f|T9l) above. Using that the infimum of a smaller set is larger 
we further have 

WKyi) = mf{f{x):xe[yi-S,y2 + S]nn} 
< inf {/(x) ■.xe[y2-S,y2 + S]n fi} 

= Isif)iy2) 

This shows that Islf) is monotone increasing on [xi — 5,X2 — 5]r\ Q. We prove that 
Ss{f) is monotone increasing on [xi + 6,X2 + S] (1 Q using a similar approach. Let 
yi,y2 £ [xi + 5,X2 + S] nQ and yi < y2. By the monotonicity of / on the interval 
[yi — 5,y2 — 5] C [xi, X2] we have 

S5{f){y2) = sup{/(x) : X e[y2-6,y2 + 6]r\ Vl} 

= sup{/(x) ■■ X e [yi - 6,y2 + S]n Q} 

> sup{/(x) ■.xE[yi-S,yi + S]r] n} 

= SsiDiyi). 



Theorem 18 For an arbitrary 6 > the operators Ls, Us and their compositions 
are all fully trend preserving. 

Proof. We will prove only that Ls is fully trend preserving since the proof of the 
statement for Us is done in a similar way. Then, the fully trend preserving property 
of the compositions follows from Theorem [161 Therefore it is sufficient to show that 
if a function / G A{fl) is monotone increasing or monotone decreasing on an interval 
[xi, X2] then so are the functions Ls{f) and {id — Ls){f). Due to the analogy we will 
only discuss the situation when / is increasing. 

Let / be monotone increasing on [xi,X2]. 

A. Proof that Ls{f) is monotone increasing on [xi,X2]. 

Applying Lemma [T71 a) to the operator Is we obtain that h{f) is monotone 
increasing on the interval [xi — |, X2 — |] fl Vt. 

Case 1. [xi - |, X2 - f ] C 
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Using again Lemma [T7] a) for the operator Ss applied to Is{f) on the interval 
[xi — |, 2:2 — |] we obtain that Ls{f) = Ss{Is{f)) is monotone increasing on [xi, 2:2]. 



|,X2 - f] 



Case 2. [xi 

Let a be the left endpoint of the interval Q. For clarity of the exposition we 
assume that a E Q but the argument also holds if this is not true. It is easy to see 
that for any g G A{Q) the function Ss{g) is monotone increasing on the interval 

[a, a + |] . Indeed, for x G [a, a + |] we have 



Ss{g){x) = sup <^ g{y) : y G 



a,x + 



where an increase in x enlarges the interval [a, + f ] resulting in a higher value 
of the supremum. The case assumption implies that [xi,X2] C [a, a+|]. Since 
Ls{f) = Ss{Is{f)) is increasing on [a, a + |] , it is also increasing on the subinterval 

[Xi,X2\. 

Case 3. If neither of the assumptions in Case 1 and Case 2 hold one obtains the 
monotonicity of Ls{f) on [xi,X2] by applying Case 1 and Case 2 to suitable subin- 
tervals of [xi, X2]. 

B. Proof that {id — Ls){f) is monotone increasing on [xi, X2]. 



Let yi,y2 G [xi, X2], yi < y2- It follows from Part A of the proof that 

Lsimyi) < Ls{f){y2). 



(20) 



Case 1. L{f){yi) = f{yi). Then using that Ls{f){y2) < f{y2) we obtain 
{id - L,(/))(yi) = /(yi) - LsU){yi) = < /(2/2) - Ls{f){y2) = {id - Ls{f)){y2) 



Case 2. L{f){yi) < f{yi)- Then we have 

Il{f){x)<Ls{f){yi)<f{yi) for all xG 
In particular, 



yi- 2^2/1 + 2 



[]Q. (21) 



h{.n ( ?/i + 2 ) = ■ ^ ^ [^I'^^i + S]nn}< Ls{f){yi) < f{yi). (22) 
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Considering the monotonicity of / on the interval [xi, X2] the above inequahty imphes 
that Hi + 5 > y2- It further follows from fl22l) that for every e > there exists 
Ve £ [?/2, 2/1 + 5] n such that 



f{ye)<Ls{f){yi)+e. 



(23) 



5 5' 
?/2 - 2'2/i + 2 



Hence we have 

h.mx) < LsU){yi) , xe 

h.{f){x)<f{y,)<U{f){y,)+e, xe 
Therefore 

Ls{f){y2) = sup I Is{f){x) : X e 



f]n (see dnD), 

(see ([23D) 



S 5 



5 5 
2/2 - 2'?/2 + 2 



f]n'j <Ls{f){y,) + e. (24) 



Since e in the inequality is arbitrary, using also (I2U1) we obtain Ls{f){y2) 
Ls{f){yi). Then by the monotonicity of / on [a;i,X2] we have 



{^d - L,(/))(yi) = f{y,) - U{f){y,) < /{y^) - Ls{f){y2) = {id - Uimy^)- 



5 Total variation preservation 

The operators L^, Us and their compositions are smoothers. Therefore, one can 
expect that they reduce the Total Variation of the functions. This is indeed true, 
but in fact these operators satisfy a much stronger property. Namely, total variation 
preservation. Denote by BV{Vt) the set of all real functions with bounded variation 
defined on f2 and denote by TV{f) the total variation of / G BV{Q). Consider an 
operator A : BV{Q) BV{Q). Since the total variation is a semi-norm on BV{Q) 
we have 

TV{f)<TV{A{f)) + TV{{zd-A){f)) , f e BV{n). (25) 

Definition 19 The operator A is called total variation preserving if 

TV{f) = TV{A{f)) + TV{{td - A){f)) , / e BV{n). (26) 
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The above definition implies that for a total variation preserving operator the 
decomposition / = A{f) + {id — A){f) does not create additional total variation. 

Theorem 20 // the operators A : BV{n) BV{n) and B : BV{Q) BV{n) are 
both total variation preserving then so is their composition Ao B. 

Proof. Using the total variation preserving property of A and B and fl25l) we have 



TV{f) = TV{BU))+TV{{td-B)U)) 

= TV{A{B{m + TV{{id - A){BU))) + TV^ - B){f)) 

> TV{{A o B){f )) + TV{{{id -A)oB + id- B){f)) 

= TV{{AoB){f)) + TV{{id-AoB){f)) 

From ([25D we also obtain TV{f) < TV{{Ao B){f))+TV{{id- Ao B){f)). Therefore 
TVif) = TViA o Bif)) + TV{{id - A o B){f)). m 



It is easy to see that BV{fl) C A{Q). Hence the operators Ls, Us are defined 
on BV{Q). We will show that L^, Us and their compositions are total variation 
preserving. The proof uses the following technical lemmas: 

Lemma 21 Let a,b ^ Q, a < b. 

(a) If there exists e > such that f{x) — Ls{f){x) > e, x E [a, b], then b — a < S 
and Ls{f){x) is a constant on [a,b]. 

(b) If there exists e > such that Us{f){x) — f{x) > e, x E [a, b], then b — a < 6 
and Us{f){x) is a constant on [a,b]. 

Proof. We will prove (a). Assume that b — a > 6. Then 




and using Lemma [3] we obtain a contradiction as follows: 



inf 



LsifM 
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Therefore b — a < 6. Let p = sup Is{f){y). Since [6 — |,a+ |] C Bs{x) 

ye[b-l,a+^] 

X G [a, b], we have 



3 



P< snp h{f){y) = Ls{f){x) < f{x) - e , xe[a,b]. 

Therefore 

We will show next that 



p< M Ls{f){z)< M f{z)-e, xe[a,b]. (27) 



h{f){y) < P for all y G 



a , H — 

2' 2 



nfi. (28) 



If y G — |, a + |] the inequality fl28l) follows directly from the definition of p. Let 
y > a + |. Then [b, a + 6] (1 C Bs(y) which implies 

h{f){y)< Jnf f{z). (29) 
Furthermore, using fl27|) . we have 

p>Is I a H — I = min I inf ff^;), inf f (s;)! > min + e, inf f(2;)l . 
2^ 2/ \ze[a,fer ^ ^ ze[b,a+5]nQ ^ ^ j - \ 2e[fe,a+5]nn ^ ^ J 

Hence 

inf f{z)<p. (30) 

The inequahty (128|) follows from (l29i) and ( l30ll . The case |/ < a + | is considered in 
a similar manner. 

Since Bs{x) C [a — |, 6 + |] , x G [a, 6], using fl28l) we obtain 

L5/(a;) = sup h{f){y) <p , x e[a,b]. (31) 

The inequalities (1271) and (13T1) imply that Ls{f){x) = p for x G [a, 6]. ■ 



Lemma 22 Let a, 6 G fi, a < b. 
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(a) If Ls{f){a) 7^ Ls{f){b) then for every e > there exists c G [a,b] such that 

(t) f{c)<mm{f{a)J{b)} 
(n) L,(/)(c) <mm{L,(/)(a),L,(/)(6)} + £ 
(m) (td - U){f){c) < mm{{td - Ls)if)ia), {id - Ls)if)ib)} 

(b) IfUs{f){a) 7^ Us{f){b) then there exists c G [a,b] such that 

(i) /(c)>max{/(a),/(6)} 
(n) Us{f){c) > max{t/5(/)(a), Us{fm} 
(m) (td - Us)if){c) > maxiiid - Us){f )ia), {id - Us)if )m 

Proof. We will prove (a) when Ls{f){a) < Ls{f){b). The rest is done in a similar 
way. 

Let V = {y > a : inf^gf^ — Ls{f){z)) > 0}. It follows from Lemma [2T] that 
for every y eV the function Ls{f) is a constant of [a, y] and y — a < 6. Therefore, 
b and a + 5 are upper bounds of V and we have 

d = sup V < min{6, a + 6}. 

Moreover, for every 77 > we have 

inf (f{z)-LsU-M)=0. (32) 

zeia,d+ri\ 

Case 1. There exists c G [a, d) such that 

/(c) - L5(/)(c) < min{/(a) - Ls{f){a), f{b) - LsifM}. 

Then (iii) is automatically satisfied. Furthermore, (ii) holds since Ls{f){c) = 
Ls{f){a) < Ls{f){b). The inequality (i) is a consequence of (ii) and (iii). 
Case 2. For every z E [a,d) we have 

f{z) - Ls{f){z) > min{/(a) - Ls{f){a), f{b) - LsifM}. (33) 

According to Lemma [2T] LAf) is constant of the interval [a,d). Let Ls{f){x) = p, 
X G [a, d). Assume that there exists ^ > such that mi ziz\^d,d+^] f{z) > p. Lemma [2T] 
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implies that d + < a + S. Then, using also (15^ . A = miz^[a,d+£,] /(-z) > P and we 
have 

p = LsU){o) > ( a + ^ ) = min{ inf f\z), inf f{z)} 



> min{p-A, inf ^ /(^).} 



Therefore 



inf /(z) < p. (34) 

2G[d+5,a+5] 

Using similar techniques as in the proof of Lemma [21] the inequality (134|) implies 
that Ls{f){x) < p < p + A < f{x), x E [a,d + which contradicts the definition 
of d. Hence 

inf f{z)<p, e>0. (35) 

2e[(i,(i+C] 

As a consequence of the above equation we have 

Lsif)id)<p. (36) 

The function /, being a function of bounded variation may have only discontinuities 
of first kind, that is, the left and right limit exist at every point. Then the inequality 
(j35l) means that 

f{d) <p OT /(rf+) < p. (37) 

The inequality fl32|) can be treated in a similar manner. Under the case assumption 
fl33l) the inequality fl32l) is equivalent to 

inf (f{z)-Ls{f){z)) = 0, ve[ 

z&[d,d+ri] 

which implies that 

f{d) = Ls{f){d) or f{d+) = Ls{f){d+). (38) 

Case 2.1 f{d) > p. Then we also have U{f){d) <p< f{d) so that (JST]) and (JSHD 
imply that f{d'^) < p and f{d'^) = Ls{f){d'^). Therefore for every e > there exists 
fj,{e) > such that 

f{z)<P + e, f{z)-Ls{f){z) <t , zeid,d + fx). 

Let e = min {e, i(/(a) - L,(/)(a)), i(/(6) - L5(/)(6))}. Then any c G (d,rf + ^(e)) 
satisfies the conditions (i)-(iii). 
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Case 2.2 f{d) = p. 

Case 2.2.1 f{d) = p = Ls{f){d). Then we take c = d. 

Case 2.2.2 f{d) =p> Ls{f){d). Then it follows from ([37D that f{d+) = Ls{f){d+). 
Assume that Ls{f){d'^) = f{d'^) > p. Then there exists 77 > such that f{z) > 
Ls{f){z) > P, z E [a,d + ri] \ {d} and f{d) = p > Ls{f){d). It is easy to see that 
this is impossible. Indeed, let Ls{f){d) < m < p. Then there exists yi G Bs{a) 
and 2/2 £ Bs_{d + rj) such that (/)(yi) > m and /«(/)(y2) > Using also that 
m is a lower bound of / on [a,d + 77] we obtain that f{z) > m, z E [ct,l3] where 
a = mm{yi,y2} — |, = max{yi,y2} + |- Since d E [a,l3] and P — a > 6 there 
exists z G Bs{d) such that Bi{z) C [a,/?]. Then Ls{f){d) > Is{f){z) > m which is 

a contradiction. Therefore Ls{f){d'^) = f{d'^) < p. Then the proof proceeds as in 
the Case 2.1. ■ 

Theorem 23 For an arbitrary 6 > the operators Ls, Us and their compositions 
are all total variation preserving operators on BV{fl). 

Proof. Let 5 > 0. We will only prove that Ls is total variation preserving, since 
the total variation preserving property of Us is proved in a similar way and the 
statement for the compositions follows directly from Theorem |20l Let 6 > and 
let {xi,X2, ■■■Xn} be an arbitrary grid of points on Q arranged in increasing order. 
We will show that there exist a finer grid {yi, y2, ■■■ym}, n < m < 2n, such that for 
every i = l,...,m — Iwe have either 



or 



Ls{f){yd + -^ > 

{id-Ls){f)iy,) > 

fiVi) < 

L5U){yi) < 

{id-Ls)U){yi) < 



fiVi+i) 

Ls{f){yt+i) 

{id - Ls){f){yi+i) 

Q 

LsU){y^+i) + 1^ 

{id - Ls){f){yi+i) 



(39) 



(40) 



This result is obtained from Lemma [22] with e = -. If Ls{f){xi) = Ls{f){xi+i) 
trivially either fl39l) or PUI) is satisfied for the points Xi and Xj+i. If Ls{f){xi) 7^ 
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Ls{f){xi+i) then according to Lemma I^^T a) there exists Cj G such that the 

inequahties ([21]) are satisfied for the points Xi and Cj and the inequahties (HUj) are 
satisfied for the points q and Xj+i. Thus by including in the grid {xi,X2, ■■■x„} a 
point Cj between Xj and Xj+i for all z such that Ls{f){xi) ^ Ls{f){xi-^i) we obtain 
a finer grid {yi, ?/2, ■••2/m} satisfying either fl39|) or fHOj) for every two consecutive 
points. Using this property, for every z = l,...,m— Iwe have 

\f{y^) - f{y^+l)\ = \[Ls{fM)-Ls{f){m^i)] + [{td-Ls){f){m)-{td-Ls){fM+,)]\ 

> \Ls{fM)-Ls{fM+i)\ -- + \{2d-Ls){fM)-{id-Ls){f){y.+i)\ 

n 

Therefore 

m—1 



TV{f)>J2\fiy^)-fiy^+i: 

i=l 

m—1 m—1 

> J2 \Ls{f){ud-Ls{f){m+i)\ + m-Ls)if Km)-itd-Ls)U-){m+i)\ - 

i=l i=l 

n— 1 n— 1 

> \Ls{f){x.)-Ls{f)ix,^i)\ + Y m-Ls)U){x,)-{^d-Ls)U){x.+i)\ - 



i=l i=l 



Since the grid {xi,X2, ...Xn] and the number 6 are arbitrary, the above inequality 
implies 

TV{f) > TV{Ls{f)) + TV{{id - Ls){f)). 
In view of (1251) this completes the proof. ■ 



6 Conclusion 

In this paper we extended the LULU operators from sequences to real functions 
defined on a real interval using the lower and upper ^-envelopes of functions. The 
obtained structure, although more general than the well known LULU structure of 
the discrete operators, retains some of its essential properties. 

Of significant importance is the link obtained between properties of functions and 
sequences that are samplings of these. Particularly, we can easily observe that if a 
function / has a good approximation Af that is 5-monotone, then a sampling of Af 
at a uniform sampling interval of h with h < then the sampling is ra-monotone. 
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and a Discrete Pulse Transform will have no (high)-resolution components less than 
n. Thus we may call Af a "pulse limited" function, in the same sense as a sequence 
is called "band limited" in the theory of Wavelet Analysis when there are no high 
frequencies present. 

Since the total variation of a function is the supremum of the total variations of 
all its samplings, we can derive that the total variation of a sequence of samplings 
does not exceed that of the function. If the functions is (^-monotone they are equal, 
provided the sampling interval h is smaller than 

This is important in image processing, where Total Variation is used as an ap- 
propriate norm |6] . It may be illuminating to consider that the energy reaching the 
ear is appropriate as a natural norm, where the power spectrum yields important 
information for economical decomposition and storage of auditory signals. 

The eye does not even see with the total illumination as norm, but rather the 
measure of contrast. It is well known that we perceive an image in the same way 
under different illumination intensities. The total Variation fits naturally as the 
sum of the absolute differences of intensity between neighbouring pixels. It turns 
out to be the natural norm in Discrete Pulse Transforms, as they have a naturally 
associated "Parceval Identity" which can be considered analogous to the Parceval 
Identity in Wavelet and Fourier Transforms, which is based on the energy distri- 
bution amongst resolution levels. We thus have a Pulse Spectrum associated with 
such a L[/L?7-decomposition, which is useful for thresholding decisions for econom- 
ical transportation and storage of the essentials of an image [6]. 
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